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Abstract 

We introduce an analytical model based on birth-death clustering processes to help 
understanding the empirical log-periodic corrections to power-law scaling and the finite- 
time singularity as reported in several domains including rupture, earthquakes, world 
population and financial systems. In our stochastics theory log-periodicities are a conse- 
quence of transient clusters induced by an entropy-like term that may reflect the amount 
of cooperative information carried by the state of a large system of different species. The 
clustering completion rates for the system are assumed to be given by a simple linear 
death process. The singularity at t a is derived in terms of birth-death clustering coeffi- 
cients. 
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1 Overview 



Increasing evidence of accelerated patterns having an overall power law behaviour with 
superimposed log-periodic oscillations has been found in a variety of applied domains. 
These observations have been reported in a series of experiments on rupture in heteroge- 
nous media fj], § and from the historical data analysis of earthquakes || |j, |5], |§, world 
population Q and financial stock markets || |, [H], |ll], |l2j, (see examples in Fig.l). 
It has been also argued that log-periodic corrections to scaling should be present in a 



wider class of out-of-equilibrium dynamical systems (see, e.g., |14|, [HI). The logarithmic 
modulations are periodic in t — t Q and not on t and are precursors to an spontaneous 
finite-time singularity t Q at which they accumulate. 

The interest in log-periodic corrections to power-law scaling is twofold. On one hand 
they enhance the fit quality to observed data with better precision than simple power 
laws by adjusting the (frequency, local minima and maxima of) oscillations. On the 
other hand their real-time monitoring could, in principle, allow for an enhancement of 
predictions in different contexts [16]. 

At the theoretical level, log-periodic oscillatory structures has been associated to 
the existence of complex fractal dimensions || and critical exponents [16], |17], [18| . 
However, as pointed out in predictions of stock market crashes using complex 
critical exponents should be taken with some concern not only because of the many 
fitting parameters required but also because the time period used to perform the fit is 
rather long [pG[| . This does not mean that the apparent acceleration and the log-periodic 
modulation do not actually exist -the whole subject deserves further investigations. 

Most recently, log-periodic patterns associated to financial crashes have also been 



shown to stem from models for stock markets inspired by percolation phenomena [21 



22] , p23f . Furthermore, logarithmic oscillations have been found in an off-lattice bead- 
spring model of a polymer chain in a quenched porous medium under the influence of 
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an external field |24| and in a uniform spin model on a fractal p5|| . However, besides 
these simulation studies, there is no a convincing microscopic theoretical model which 
substantiates the idea that the singularity at finite t Q (e.g., a financial crash) is a critical 
point. Also, there is as yet no a fundamental theory that substantiates the claim for the 
precursory, universal log-periodic oscillations on large time scales. 

In this work we made an attempt to provide a new scenario within which to elab- 
orate an analytical microscopic theory and contribute towards an understanding of the 
underlying physics of log-periodic patterns. We introduce an stochastics model based 
on birth-death clustering processes to sustain the claim of log-periodic corrections to 
scaling and of a finite-time singularity. In our theory transient clusters are formed fol- 
lowing an entropy-like formula that may reflect the amount of cooperative information 
(or disorder) carried by the state of a large system of different species. The clustering 
completion rates for the system are assumed to be exponentially distributed according 
to a simple linear death process. The singularity at t a is derived in terms of birth-death 
clustering coefficients. 

2 Stochastics theory 

We write the governing equation for power law behaviour decorated by large scale log- 
periodic oscillations as a superposition of two terms 

G(t)=G (t) + (?«,(*) , (1) 

where Go takes the form of a pure power law and represents the (universal periodic) 
corrections. 

Similarly to |], 0, the first term is taken to be 

K{t -ty- 1 , (2) 



di 
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with t a a finite time at which a singularity appears and the exponent a satisfies a / 1, 
Integration of this equation yields 

G (t) = G (t o )~-(t o -t) a ; . (3) 
a 

In the following we seek for an approximate form to the correction term Goo. 

2.1 Galerkin finite elements method for Gjsf(s,t) 

The starting point of our theory is to assume that the two-dimensional (e.g., energy 
and time dependent) Gn function of a discretized system of N nodes is the solution of 
some non-linear differential equation (e.g., a diffusion equation with particular boundary 
conditions) which we do not know but we shall figure out the answer. 

Using the standard Galerkin finite elements method described in the Appendix (see 
also, e.g., f26|), a general trial solution to this unknown differential equation can be 
approximated as 

N 

G N (s,t) = 1 £9 j (s)P j {t) , (4) 

3=0 

where gj are basic (interpolation) functions, and Pj are the so-called test functions. The 
terms gj(s) are often referred to as trial functions and Eq.@ as the trial solution at 
nodal points. 

Without loss of generality, for all t and different j-states we can rewrite P in a more 
suitable form as the sum of even and odd parts 

P j (t)=p 2j (t)+P2 J+ i(t) ■ (j = 0,l,2,---,A0 (5) 

This means that P = p + pi, P\=P2+ P3, P% = Pa + Ps, 
Hence, in the limit N — * oo, we then get 

oo oo 

E^) = E^(0 = i , (6) 

3=0 j=0 



a result that will prove useful later when we associate the test functions Pj with the 
equilibrium state probabilities to be characterized by birth-death processes. 



2.1.1 Birth-death model for pj(t) - Effect of disorder 

The test functions Pj(t) are usually determined by solving a system of differential equa- 
tions (in time) generated by some governing equation, and if N is made arbitrarily large 
the error introduced becomes small (see Appendix). In order to gain insight into the 
dynamics leading to log-periodic structures, we take next a different approach and re- 
late the test functions to a large number of processes forming clusters or aggregates 
that change as a function of time (e.g., cell populations, customers queueing, interactive 
multi-agent ensembles, investors groups) acting collectively to pass on information or to 
introduce system disorder. 

We assume that stochastics "births" and "deaths" clustering processes occur ac- 
cording to a simple one-dimensional birth- and- death model (see, e.g., ||27|1 ). The state 
probabilities Pj(t) in this case are obtained recursively from 

\At)P&) = fa+i(t)Pi+i(t) ; (; = 0,1,2,...) (7) 

By a choice of the birth coefficients Xj > and of the death coefficients jlj > 0, var- 
ious stochastics models can be constructed (e.g., queueing models in which costumers 
corresponds to the "population", arrivals are "births" and departures are "deaths"). In 
other words, the quantity A is interpreted as the birth rate and \x the death rate when 
the population is at the state j. 

Eq.(0) together with the normalization condition of Eq.(||) can easily be solved to 
yield the following statistical-equilibrium state distribution (as seen from an arbitrary 
outside observer) 

_ f1 .\ _ A (t)Ai(t)..-A i _ 1 (t) 



This means that for each time t > the state probabilities can, in principle, be deter- 
mined subject to specification of the initial conditions Po(t) (i.e., the so-called absorbing 
state) and the product of birth-death ratios at all previous states. 

To obtain the above transient solution for Pj(t) (i.e., for finite t) in closed form, it 
is necessary to postulate basic expressions for Xj and fij. Here we assume that -for the 
case of a finite probability distribution, i.e., Pj(t) > (with j = 1,2, ■ ■ ■ , N)- clusters 
form via an entropy-like formula 



M 



X 3 (t) = -J2 X k(t)\n\ k (t)>0 ; (j = 0,l,2,---,iV-l) (9) 

k=l 

with A > for all k. According to information theory the shape of our birth 
coefficients may reflect the measure of cooperative information carried by the outcomes 
Ai, • • • , Xm (or the amount of disorder in the discrete observable Xj) in a system of M 
different species or types (e.g., human gender, financial traders). 

On the other hand, in analogy to Erlang loss systems f27j, we assume the clustering 



completion rate for the system in state j to be exponentially distributed (with rate 
H > 0), hence we deal with simple linear death processes 

fij(t)=jfi(t) ; (j = l,2,---,N) . (10) 

Then, the equilibrium state probabilities given by Eq.(|8]) become 



J2 a k m Afc(t) 



k=l 



p (t) , (j=0,l,2,---,A0 (11) 



where the per-capita ratio = Xk(t)/fi(t) > is, for simplicity, assumed to be time 
independent. This means that and /i should both scale as power laws of the form 
~ At ±n . 

By using the normalization condition of Eq.(O) plus Eq.(|TT|) an d the Taylor series 



6 



expansions for the exponential function, we also obtain 

1 =e r »® , (12) 
where 

M M 

T M (t) = Y / a k \nX k (t)=\nY[\ a k k (t)=ln Po (t) . (13) 

k=l k=l 

Now that we have a precise formulation for Pj(t), we can set trial functions for the 
basic interpolation functions gj to solve for Gjv(s, t) given in Eq.(|). 

2.1.2 Trial gj(s) functions 

The efficiency of the Galerkin formulation is very dependent on making the correct 
choice of the approximating test and trial functions (see Appendix). Of the many nodal 
unknowns that could be candidates, here we consider the polynomial expansion 

= -^^ = 7{(-i) i +(^ , (14) 

with s a dimensionless variable. 

Substitution of Eq.(|TT|) into (|j) and using Eq. (|T3"D plus these trial functions, it gives 
the approximate trial solution 

G ^ = wW g_{i^ij} W + ti_rS}«( t) } , (is) 

as is easily verified. 

We shall see next that our gj functions make a judicious choice. 



?! 
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2.2 Onset of log-periodicity 

Let us consider large systems in statistical equilibrium and adopt the following notation 
for the required correction term of Eq.(Q) near t Q : 

G^it) = lim G N (s wO,t) . (16) 

N— >oo 

For the sake of simplicity we have set s ~ in order to gain insight into the genesis of 
log-periodicities. 

As an example, our approximate trial solution of Eq.(|l5|) thus becomes 

Geo(t)=7Po(t){E^r^^ . (17) 

Using Taylor series expansions for the cosine and sine functions plus the trigonometric 
identity cos(a + b) = cos(a) cos(6) — sin(a) sin(6), such that a = 7r/4 and b/2-K = r^-(t) 
in radians, the above equation then results in 

(?«,(*) = V2 T po(t)cos^27rlnp (t) + ^) , (18) 

with p satisfying Eq . ([13|) . 

This equation characterizes the complexity of the underlying dynamics of the scal- 
ing systems under consideration. It can be seen that in our stochastics theory the 
log-periodic modulation is a consequence of the entropy-like assumption used for the 
transmission of information within the birth-death clustering processes. 

Using our expression for the initial boundary condition p leading to Eq. (|18D , we 
analyse next the presence of a singularity at a finite time where the oscillations accu- 
mulate. 
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2.3 Finite-time singularity 

As discussed in the derivation of Eq.flTTD /x should scale with t, so we set 

^(t)~(t -t) ±n , (19) 

where n 7^ is a given exponent and t Q charaterizes the finite-time singularty. Hence, 
according to our definitions 

A*(t) ~a k (t -t) ±n , (20) 

which implies that within our stochastics birth-death theory we can consider finite values 
of time t <t (or n even only if t > t Q ) since the coefficients Afc and fik (and, therefore, 
a^) are all positive. 

By substitution of this scaling into Eq. ([13|) , we finally get 

M AI 

po(t) = UK k (t) = e M m t o't) ±nak , (21) 

k=l k=l 

where 

M 

8jf=n«f • ( 22 ) 

k=l 



Thus from this relation and Eq. (|T8|), we are able to derive log-periodic corrections in 
the form of Goo for t <t D . 

3 Discussion 

Having introduced our theory based on stochastics clustering processes to describe log- 
periodic corrections to scaling and a finite-time singularity at t Q , we use Eqs. ([]]), ©, 
(H) and (|T]) to obtain 

G(t) =A + B(t -t) a + C(t -t) /3 cos(27T(3\n(t -t)+^ , (23) 



where A = Go(t ), B = —n/a, and a are parameters relating the pure power law term 
of the governing Eq.fTI]) and 

M 

C = V2je M , /?=±n]Ta fc , ^ = 27rlne M + I , (24) 

k=i 4 

are the parameters of the log-periodic corrections in terms of our stochastics birth- 
death model parameters. The fit of this equation to historical random data displaying 
accelerated precursory patterns and an spontaneous singularity, which indicates the 
sharp transition to a new regime, is presented in Fig.l. 

As an illustrative example, in Fig.l we plot the daily Log(S&P500) stock index closing 
values during the years 1982-1988 PU| , the estimated 1000-2000 world population by the 
U.N. Population Division p{| and the sum of seismic activities measured near the Virgin 
Islands between Apr. 1979 and Feb. 1980 Ell. Our best fits with Eq.([23|) to these data 
sets have been done as follows: 





A 


B 


C 


a 




to 




rms 


S&P500 index 


1.51 


4.34 


-0.01 


-0.1 


1.42 


1988.62 


1.85 


0.053 


World population 


0.25 


1489.74 


-25.24 


-1.38 


-1.04 


2054.61 


-6.34 


0.047 


Seismic activity 


-1.38 


1.18 


-0.04 


-0.74 


-1.25 


1980.29 


0.78 


0.414 



Examination of the plotted curves shows that Eq . (123|) can model log-periodic cor- 
rections to the leading scaling behaviour and a singularity at t a in different applied 
domains similarly to the methods inspired by renormalization group theory entailing 
complex critical exponents. If we set a = (3 = 1/f we can approach the results ob- 
tained in |[ where market crashes, population explosion, and culminating large 
earthquakes are viewed as critical points in a system with an underlying discrete scale 
invariance. If we set a ^ (3, our results are then comparable to those obtained using 
the more general anzat of two different exponents as in ||10| . The main difference of our 
stochastics theory with respect to the critical exponent approach is the presence of the 
exponent (3 also appearing in the argument of the cosine function. Since n and are 
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positive then from Eq.(p4|) we have that (3 7^ 0. Furthermore, in our stochastics theory 
the finite time t is also determined in function of j3 as discussed below. 

So far, the fitting in Fig.l allows us to argue that the apparent logarithmic period- 
icities in scaling systems may also be understood within the context of an stochastics 
analytical model based on birth-death clustering processes which is the distinctive fea- 
ture of our stochastics theory. We can interpret the "births" and the "deaths" clusterings 
in different ways. For financial systems the "births" and "deaths" may represent, e.g., 
the buyers and the sellers, respectively. Whereas newborns and deceases would be in 
correspondence with the population growth. Some absorbed- and released- energy may 
relate the "births" and "deaths" in the case of seismic events for finite times t < t a . 

The recurrence Eqs.(0) are conservation- of- flow relations. That is, the long-run rate 
at which the system moves up from state j to j + 1 equals the rate at which the system 
moves down from state j + 1 to j (i.e., rate up = rate down). Thus, birth-death processes 
describe the stochastic evolution in time of a random variable whose values varies (i.e., 
increases or decreases) by one in a single event (or state) starting from the absorbing 
state p a . 

The spontaneous singularity is here related to the birth-death coefficients which in 
turn determinate p Q , i.e. the initial boundary condition at the state j = via Eq.([T2p. 
It is also important to note that the state distribution coefficient defined by 



depends on the logarithm of the absorbing state via Eq. (|T^) . 

In the absence of a well-defined non-linear dynamical equation governing log-periodic 
corrections to power-law scaling, we have adopted the standard Galerkin finite elements 
method as the starting point to search for a general trial solution to this "unknown" 
differential equation. The motivation for our basic interpolation functions gj(s) follows 




(25) 
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computational finite-element methods which are characterized by the use of polynomials 
for the known test functions (obtained from Eqs.(^) to (0)) as well as for the unkown 
trial functions of Eq.(|14D in subdomains called finite elements ||26|| . 

As discussed in the Appendix, our trial gj(s)'s would allow to solve the matrix 
equation for the test functions, which have been related to a large number of (birth- 
death) processes forming clusters, provided the governing equation of the problem would 
be known. These forms, using s ~ 0, were taken for convenience to gain insight into the 
onset of log-periodicities. If we consider instead small s « 1, we would obtain rather 
similar conclusions after some algebra. 

We thus argue that log-periodicities are a consequence of transient clusters induced 
by the entropy-like term given in Eq.(^) which may reflect the amount of cooperative 
information carried by the state of a large system (i.e., N — > oo) of different species M. 
Using the definition of the amount of (discrete) finite information or entropy, it can be 
shown that the information is additive under concatenation of independent probabilities 
as the logarithm function is. It has been proved that it is possible to define information 
without necessarily using the concept of probability (see, e.g., P5| ). We have adopted 
the latter definition in this work via Eq.(|9|) for the birth coefficients. The clustering 
completion rates for the system are given by a simple linear death process. 

The state probablities pj are normalized via Eq.(^|). We may also consider that the 
total sum of outcomes is constant for all time as in the Shannon theory of information 
28] . Therefore, for the whole range M of different species we set 



M 

£A*(t)=&>0 . (26) 
fc=i 



We can then estimate the finite time t at which a singularity appears from Eqs.(pO| 
and (El) by considering the initial time t — to thus obtain the relation 



e = ^p • (27) 
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From the examples in Fig.l we found for the Log(S&P500) stock index: n = 0.105, £ D = 
30. World population: n = —0.209, £ c = 1. Accumulated seismic activity: n = —0.226, 

£o = i- 

The per-capita ratios plus the exponent n appearing in the scaling of Eq.fll9"|) 
are the minimum ingredients required to derive a complete description of log-periodic 
corrections to scaling and finite-time singularities within the framework of an stochastics 
theory based on birth-death clustering processes. The positive state distributions pj are 
determined by n and which also relate the exponent (3, C and ip as in Eq. (|23|) and t Q as 
in Eq . (p7|) . This means that such state distributions of the system drive the log-periodic 
oscillations. We believe this feature of our stochastic model can help to elaborate a 
general microscopic theory to understand the underlying mechanisms of log-periodic 
patterns. In the case of financial systems, such microscopic theory should also explain 
the peculiar statistical features in short time scales such as the highly correlated variance 



or volatility of price fluctuations [[H], 0, by exploring the state distribution coefficient 
given by Eq. (B5|) . 
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Appendix: The Galerkin formulation 



In this appendix, the key features of the standard Galerkin finite elements method are 
stated concisely for completeness |26|. If a 2D problem in a domain D(x,y) is governed 
by a linear differential equation L(u) = 0, with boundary conditions S(u) = on 5D, 
i.e., the boundary of D. Then, the Galerkin method assumes that u can be accurately 
represented by the approximate trial solution 

N 

u(x,y) = u (x,y) + J2 a j(v) ( i ) j( x ) ( 28 ) 

3=1 

where the (p/s are known, trial analytical functions, u Q is chosen to satisfy the boundary 
conditions, and the a/s are test functions to be determined. 

To obtain the unknown a/s, the inner product of the weighted residual R is set equal 
to zero: 

{R, (j) k ) = J J R0 k dxdy = , k = 1, • • • , N , (29) 

where 

N 

i?(a ,ai ■ ■ -a N ,x,y) = L(u) = L(u D ) + Y, a j{y) L (<f>j) ■ ( 30 ) 

i=i 

Since this example is based on a linear L(u), then the above can be rewritten as a 
matrix equation for the dj S cLS 

N 

J2aj{t)L(<f>j,<t>k) = -L(u ,(p k ) . (31) 
i=i 

Substitution of the a/s resulting from this equation into Eq.(^8|) gives the required 
approximate solution u(x,y). 
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gure caption 

• Fig.l: Illustrative examples of log-periodic patterns. Full line curves are the fit of 
our birth-death clustering theory using Eq. (p3|) . These fits allow to estimate the 
total sum of outcomes Afc. 
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